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Abstract 

Mathematical problems with mean field and local type interaction re- 
lated to stochastic chemical kinetics^are considered' Our main concern 
"various definitions of reversibility, their corollaries (Boltzmann type equa- 
tions, fluctuations,Pnsager relations, etc) and emergence of irreversibility. 
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1 Introduction 

It is known that any closed dynamical system has sufficiently simple behavior - 
it tends to equilibrium' One of the reasons for such a behavior is time reversibil- 
ity of the dynamics' In biology we have completely different ,jnore complicated^ 
behavior Standard approach of biological and chemical theories to explain com- 
plicated biological phenomena is to select some suitable non-reversible system 
of chemical reactions. It is rather clear that in such a way any behavior can 
be explained, that reduces the value of the theory. At the same time, any non- 
reversible system of reactions can be formally deduced from (reversible) laws of 
physics only under some scaling limits. 

In this review we discuss mathematical problems related to the reversibility 
and non-reversibility of chemical reaction systems. 

In section 2 we consider connections between various probabilistic charac- 
teristics of chemical reaction systems. We give classical and stochastic descrip- 
tion of chemical reaction system. Classical chemical kinetics is the core of any 
theoretical and applied investigations in biology. Stochastic chemical kinetics 
had always been more theoretical, however also its applied aspect emerges, see 
[H [31 [S] . We study how the fact of the invariance of Poisson measure is related 
to 3 main variants if reversibility for chemical reaction systems: chemical re- 
versibility, reversibility as in Markov processes theory and unitarity. At the end 
of the section we touch the (yet non developed) case of large number of molecule 
types. 

The main question is how chemical reaction systems behave for large times. 
In section 3 it is shown that, under the reversibility assumption this behavior is 
rather simple - the system tends to a fixed point, that is to equilibrium. Dynam- 
ics in the vicinity of the fixed point is normally described by two physical theo- 
ries: linear perturbations which bring us to Onsager relations, and even smaller 
perturbations - stochastic fluctuations. We present here rigorous versions of 
these theories. Finally, we present two ways of emergence of non-reversibility i 
n chemical reaction systems - transport and time scaling. 

In physics, a well-known procedure to get non-reversibility is the limiting 
transition to Boltzmann equation. Stochastic and classical chemical kinetics are 
typical examples of the theories which are called mean field theories in physics. 
In section 4 we consider various possibilities of how to to introduce locality in 
chemical reaction systems with infinite number of particles. We specify 3 kinds 
of scaling which give deterministic quasilinear partial differential equations with 
nonlinear term similar to the right-hand part of the equations ^ of classical 
chemical kinetics: 
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1. canonical scaling with M oo in chemical kinetics, where simultaneously 

the particles move in the space; 

2. the Boltzmann-Grad limit in the particle system with local chemical re- 
actions; 

3. standard hydrodynamic scaling for particle systems performing random 
walk on a lattice. 

In Newtonian and quantum mechanics the notion of reversibility is different and 
natural question is how this is related to previous definitions. We touch this 
in section 5. Moreover, in all models of chemical kinetics, considered in earlier 
sections, the reactions are instant events. In fact however, reactions takes some 
time interval which in both classical and quantum scattering theories is even 
formally infinite. This means that scattering theory and chemical kinetics lie 
on different timescales, sufficiently separated from each other. In despite of 
this, the reaction intensities should be possible to calculate from mathematical 
scattering theory. At the end of section 5 we introduce the notion of metastable 
particle, that is a particle with finite life time, not as a singularity (resonance) 
in the spectnun of a finite particle operator, but how some local formation in 
the infinite particle system. 

2 Stochastic chemical kinetics 

2.1 Stochastic and classical description of chemical reac- 
tions 

Assume there are finite molecule types Ay,v = 1,...,V. The chemical reaction 
r is defined by the vectors rf_(r) = {d-{v,r)},d+{r) = {d+{v,r)} of stoichio- 
metric coefficients, where the non-negative integers d-{v,r) arc the multiplcs- 
of the substrate Ay of type v, d+{v,r) are the multiples- of the product of type 
V. The reactions is written formally as 

^d_{v,r)Ay -^^d+(v,r)Ay 

V V 

Consider the system of chemical reactions, that is the Markov process M. with 
the states n = (ni, , nv) and R transitions (reaction types) r = 1, 2, R 

Uy ^ ny + d+{v,r) - d-{v,r),v = 1, V (1) 

where riy is the number of molecules of type v. 

Here we should do the following comment. Below in section 5, especially in 
5.3, we discuss how the given stochastic model of chemical kinetics is related to 
the basic principles of physics. Note however that there is no rigorous deduction 
of this model from basic postulates. Here two problems appear. The first one is 
related in stochastic chemical kinetics the time scale is coarser comparative with 
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the time of one reaction. This time can be calculated using quantum scattering 
theory. However, even for the simplest reactions such calculations are sufficiently 
complicated and, moreover, the separation of these two scales had never been 
realized in a rigorous way. This would be sufficient to deduce the local models 
considered below in sections 4, from the first principles. However in sections 2 
and 3 we consider mean field models. And the second problems is how the mean 
field models are related to local models. We do not give answer to this question, 
which appears always when in physics one uses mean field models. One should 
say however that the limiting Boltzmann equations in mean field and local case 
differ only by renormalization of the reaction intensities. An intermediate case 
could be the Kac model where the molecule can react not with each other, but 
only with molecules situated on a distance not bigger than eL, where L is the 
diameter of the system. 

The reaction r, that is the transition ([T]), has the rate (speed of the reaction 
in chemical kinetics) 

Xr{n)^Xr{n^n-d-{r)+d+{r))^M-"'-^'^^+^ar [| n„...K-d_ (w, r)+l), 

uG/(r) 

(2) 

where are the fixed numbers (constants of the speed in chemical kinetics), 
M is the scaling coefhcient, and 

m^{r) = d^{v, r), I{r) = {v : {v, r) > 0} 

V 

The power of AI in © corresponds to the so called canonical scaling, as defined 
in[n]. 

Note that equation ^ expresses the law of mass action, well-known in chem- 
ical kinetics. 

We will also consider distinguished reactions "input" and "output" 

^ ^ 

with the rates Ma^.m and ay^outny correspondingly. If there are no such reac- 
tions in the system, we will call the system closed, otherwise open. 

Note shortly that the history of stochastic chemical kinetics starts with the 
paper [3], the subsequent story consisted mainly in the study of systems wit 
small R and V, see references in [71|S]. 



2.1.1 Convergence to the equations of classical kinetics 

Classical kinetics can be obtained from the stochastic one in the limit M ^ oo. 
Namely, we consider the family of processes 7i^(t) — ni^^\t), depending on the 
parameter M. We cite here the well-known result, see references in [T7], under 
more general assumptions, including possible input and output. 

Theorem 1 Assume that initially the limits 

,,(0)= lim ^ 
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exist for all v. Then for any v and t > there exist the following limits in 
probability 

c^it)^ lim ^ 

which satisfy the following equations ( the standard equations of chemical kinet- 
ics) 



r:v^O{r) w^I(r) r:v^I{r) w^I{r) 

(3) 

where 

0{r) = {v : d+{v,r) > 0} 

The conservation laws ensure compactness. Let be the number of atoms 
of type b in the molecule of type v. Then for all reactions r (except input and 
output) and all atom types b one has 

d^{v,r)wbv = ^ d+{v,r)wbv 

vel{r) ueO(r) 

Note that the limiting terms for input and output are 

V 

If there are no conservation laws then in general the trajectory can go to 
infinity or can reach a fixed point for finite time. The proof of the theorem for 
this case see in |17) . 

2.2 Unitarity and invariance of the Poisson measure 

The condition for the invariance of the Poisson measure for the Markov process 
M 

H{n) ^l[^e-~^\K ^ Mb, 

V 

where are some fixed parameters, can be written as the equality of output 

Font = /^(n)^ A^(n) (4) 

r 

and input 

r 

probability flows for any given state n = Note that by ^ the 

summation in the right-hand side of Q is only over admissible reactions that 
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is on the reaction such that Uy — d-{v,r) > 0, and in the right-hand side of ^ 
is over r such that n[ — c?_ (w, r) — — r) > 0. 

Using 

^J-jn') _ -i-j- ^n'^ -n^ nj 

where = Font, we get, dividing by and using the uniqueness of defining 
n'^ in terms of riy and r: — d^{v,r) = riv — r) 

^M-™-W+ia.n^:"^"^<-« - d-iv,r) + 1) = 

r V ^ 

= ^M-™-W+ia, ]^ -d_(v,r) + l) 

r v£l{r) 

or 

Finally 

^M-"+M+ia, [] 6^("''')-'^+("''^)n„...K-(i+(^;,r) + l) 

r De/(r) 

= ^M-"-M+ia, [| ny...{ny-d-iv,r) + l) (6) 

where m+(r) = r7i_(r) - I]i,e/(r)(c'-(^'>'') ^ d,+ (v,r)). 

Theorem 2 T/ie following statements are equivalent: 

1 ) The Poisson measure ^ is invariant under the given system of chemical 
reactions; 

2) (Stueckelherg condition, or unitarity condition) for any vector d one has 

^ a. n ^'-^""^^ = E n ^'-^"'^^ (7) 

r:d-{r)—d v^I{r) r:d^{r)—d vGl(r) 

Proof. By reversibility of the previous calculation we have proved that con- 
dition 1) is equivalent to the condition Let us use the fact that for the 
polynomial of Uy equal zero it is necessary and sufficient that all coefficients of 
its quasimonoms were zero. Two equal monoms are defined by the vector 

d^d^{r)^d+{r) 

Note also that the scaling coefficients cancel, as m-{r) = m+(r). 

Note that condition ([7]) has sense also for classical deterministic chemical 
kinetics where it can be interpreted as follows: the sum of reaction rates creating 
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the (and only this) group of particles characterized by the vector d, is equal to 
the sum of reaction rates which annihilate this (and only this) group. 

A. N. Rybko remarked that, under the condition of the existence of invari- 
ant Poisson measure, time reversal in a process of stochastic chemical kinetics 
brings to the process of the same type, but in general with other set of chemical 
reactions. 

2.3 Reversibility in probability theory 

Probability theory has its own notion of time reversibility. Stationary random 
process Xt is called time reversible, if the finite-dimensional distributions of the 
processes Xt and Yt = X^t coincide. For Markov processes (for example, with 
denumerable number of states and continuous time) this definition is equivalent 
to the following detailed balance condition 

where Ay are the transition rates, tt is the invariant measure of the Markov 
process. The latter definition can be applied also to the time homogeneous but 
not stationary, that is to null recurrent and non-recurrent Markov processes, but 
only if there exists (now infinite) non-negative measure tt on the state space, 
satisfying condition (|S]). This will be called reversibility with respect to measure 
TT. If TT equals one in each point, then reversibility is equivalent to the symmetry 
of the matrix (A^ ). That is why any reversible chain can be obtained from the 
chain with symmetric transition matrix by the transformation 

Ay WiXijWj^,Wi = 

Kolmogorov criterion of reversibility of the Markov process with respect to 
measure tt consists in the fulfillment of the inequalities 

Aiii2 Ai2 23 ■ • • A^^i^ — Xiiijj^Xi^i^ -^.,.Xi2ii 

for any sequence of states ii,...,i„. Under this condition, using definition (|8]), 
measure tt is easily constructed as 

_ _ Ay 

for any sequence of states zi, i„, where 

k 

where the sum is over all states fc ^ 0, G{0, k) is some path from to fc, that is 
a sequence of states iq, ii, in such that iq — 0,in = k, and 
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2.4 Chemical reversibility 

The notion of chemical reversibility can be introduced in the general framework 
of Markov chains. Assume that on a given state space X be given some finite 
set A of transition matrices A^„,m,n € X,a € A for some continuous time 
Markov chains. The elements of the set A will be called "chemical reactions". 
Assume that on A the involution operation is defined - the reverse reaction 
a — ?► a' 7^ a, so that {a')' — a. 

Define the Af arkov chain on X by the transition rates 

\ - \^ A" 



We call such chain chemically reversible, if there exists a probability distribution 
7r„ on X, that is for all a the following condition is holds 

\a \Q 

In classical chemical kinetics the inverse reaction r' to the reaction r is 
uniquely defined by the conditions d-(r) = d+(r'), (i_ (r') = d^(r). 

For classical kinetics the detailed balance condition - that is the equality of 
the rates of direct and inverse reactions - looks as follows 

ar n ^'-^"■'^^ = n ^^^"'"'^ 

v£l{r) vel{r') 

We shall see the difference between conditions and ([SJ. 

Theorem 3 Let the chemical reaction system be given where for any reaction r 
there exists an inverse reaction r, Then the following conditions are equivalent: 

1 ) The corresponding Markov process is chemically reversible; 

2) The chemical reaction system is reversible (as the random process) with 
respect to some Poisson measure. 

Proof. 

(1 — >■ 2) For a pair r, r' of two mutually inverse reactions the condition of 
chemical reversibility is 

for some measure 7r„ and for any n,n' ^ n — d^ (r) + Denote 

z„ = log(7r„ 



then instead of (fTOl) we have 



Zn - Zn' = log — (11) 



Or 
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Denote Ir the right-hand side of ([TI]) . it is called the equilibrium constant in 
chemistry. Is we assume that in the given chemical reaction system A all vectors 

d = d{r) ^ (r) - d+{r),r e A 

are different then we can consider Ir as a function l{d) oi d — d{r). However it 
can occur that different reactions have equal vectors d{r). Anyway, we have the 
following properties of l{d): 

1. from the right-hand side of ([TT|) and from d{r) = —d{r'), it follows 
l{d) = -l{-d); 

2. from the left-hand side of PT|) it follows: if for some sequence of reactions 
n, ...,rfc one has X^Li '^(''O = 0' ^^^'^^ 

k 

1=1 

From these two properties it follows that l{d) can be extended to an (additive) 
homeomorphism (j) of additive subgroup Q C to R, where V is the number 
of molecule types in the system, and Q is generated by all vectors d{r) , that is 

This homomorphism can be extended to the additive homomorphism of to 
R. Any such homomorphism can be written as 

V 

for some real numbers ay . 

Now one can check that the Poisson measure 

it"" 

^^" = 11^^""" (12) 

V 

satisfies condition (jTU]). We have 

Wn = l0g(p„ J]^ = " X! """" + COJ^si 

V V 

and hence, for any pair of vectors n, n' such that n' = n — d^ (r) + c?+ (r), we get 
Wn - Wn' = aydy{r) = l{d{r)),l{d{r)) = log — 

Or 

V 

It follows that the measure Pn satisfies equation or, that is equivalent 
(fTO|) . Hence, the considered Markov chain has this measure as a stationary 
distribution, moreover it is reversible with respect to this measure. 
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(2 — !> 1) Reversibility condition of the Markov process with respect to the 
Poisson measure ([T2|) is that for any two vectors n, n' 



r V 



PnT. -rli = Pn' E (,,_"^'(,)), (13) 



where the summation is over all reactions r such that riy — n'^ ^ (r) — (1+ (r) 
and riv > d-{r) for all v. From JTS]) it follows that 

n E «^ n k-Lm)! ^ n e n 



r 1) 



Hence 



E «^ n ^^'"'"'^^ _ L (r))! - ^ n (n„ - L (r))! 



r V 



under the same agreement concerning summation. Otherwise speaking 
^a,na^W-'^+Mn,„...K -d_(r) + 1) = 



r V 



= E «r JJ?^t;•■•('^t; ^ d-{r) + 1) 



r V 



for fixed n„ and c?(r). As n^, are arbitrary, the latter equation can hold only 
if for the vector d^{r) (and corresponding vector = d{r) + d^{r)) the 

following equality holds 

V 

This condition is obviously equivalent to the chemical reversibility for the Pois- 
son measure ([T0|) and to the detailed balance condition ([9]) as well. 

Remark 4 The Schloegl example, see below section 3.1, shows, that the stochas- 
tic reversibility does not imply the invariance of a Poisson measure. 



2.5 Large number of types 

We do not give here exact formulations but indicate interesting classes of prob- 
lems. The models where V is large, physically may correspond to two quite 
different situations, that we consider below. In the first case the system is sub- 
divided into marge number of cells. One can imagine that the cells form some 
space subdivision. In each cell the number of substance (molecule) types is 
bounded. Any substance can react only with the substances from the same cell 
or neighbor cells, the number of neighbor cells is also bounded. In the second 
case the number of substance types in each cell may be large. Moreover, even if 
the number of atom types is bounded, the number of atoms in a molecule can 
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be very large. Even more, most interesting situations appear when the reaction 
rates are large, that is the life time of these substances are short. Then all sub- 
stances influence the evolution of the system. Substances with short life time 
correspond to the so called metastable molecules or clusters, as they are called 
in chemistry. 

Locally finite reaction networks We will introduce them for the case when 

'^d+{v,r),'^d-{v,r) 

V V 

are uniformly bounded in r , and 

Y,d+{v,r),Y,d-{v,r) 

r r 

are uniformly bounded in v. Then V can be taken countable. 

The infinite system of equations of classical kinetics can be deduced as above. 
Of course, M again has the sense of the volume but not the whole volume, but 
only local volume of each cell. 

Unitarity condition and theorem 2 can be generalized to such infinite case. 
Markov reversibility condition is well-known for the locally interacting process, 
our system may fit to this case. In the same spirit the chemical reversibility 
condition can be generalized. 

Models with large clusters Let we have only one type of elementary atoms 
and the clusters differ only by size. Formally speaking, we consider the partitions 
of the set with N elements-atoms into subsets which we call clusters. Let ruy 
be the number of clusters of size v = 1, V, that is consisting of v atoms, we 
assume the conservation law 

vniy = N 

V 

but the number N initially can be random, the number of types V is fixed, but 
finally we will be interested with the asymptotics when F — )• oo. Define the 
Markov chain, the states of which are the vectors m ~ {mi, ...,mN)- Possible 
reactions: 1) r„ - appending of a particle to a cluster of size n > 1 

mi mi - 1, m„ m„ - 1, m„+i m„+i + 1, 

and joining ri of the two particles 

mi ^ mi — 2, m2 — )• m2 + 1 

2) - separation of a particle from the cluster of size n > 2. 

mi mi + 1, m„ m„ - 1, m„_i m„_i + 1 
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and decay r'^ of two-particle cluster 

mi — >■ mi + 2, m2 — > m2 — 1 

Their rates do not depend of course on V, N. Assume that 

that chemical reversibility condition holds for any pair r„,r^_|_i. Denote tt the 
stationary Poisson distribution for this chain with parameters by. Then the 
chemical reversibility condition gives for all n = 1, 2, 

These relations allow to construct many examples. In particular, for any given 
sequence of positive integers 61,62, ... one can uniquely find the fractions ^ of 
direct and inverse reaction rates. Some examples of this kind with concrete 
a„ , one can find in the book [llj , where however small ensembles are consid- 
ered. 



3 Complexity of behavior and non-reversibility 
3.1 Fixed points 

Consider first the equations ^ of classical chemical kinetics. It appears that 
under the unitarity condition (hence, under reversibility conditions) their solu- 
tions have sufficiently simple behavior. 

The Boltzmann entropy of the positive vector of concentrations c = (ci , cy ) 
with respect to some fixed non- negative measure c° on {1, V} is defined as 

H{c) = Hic,c°)^Y.''^ In^-H^c, =^c,ln^ 

Cy Cy 

V V V 

Note that the factor e cannot be omitted, if the number of particles is not 
conserved. It is interesting that this expression is quite similar to the expression 
of entropy for mixture of ideal gases, see O [19]. 

Theorem 5 Assume that for a given chemical reaction system there exists vec- 
tor c° > 0, with respect to which the system satisfies the unitarity condition (0). 
The the following assertions hold: 

1) for any solution Cy(t) of kinetic equations with any initial condition 
Cy(0) the entropy is non- decreasing, that is 

dH{c{t)) ^ ^ 
dt 

2) as t ^ 00 any solution c{t) of equations (0) tends to some fixed point c^c, 
which in general depends on c(0); 

3) unitarity condition holds for any fixed point of equations (0); 

4) tf for some fixed point the detailed balance condition holds, it also holds 
for any other fixed point. 

Proof of these assertions can be found in [T7] . 
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Systems with one particle type Without unitarity condition such simple 
behavior is rarely possible. It is instructive to consider the following examples 
with one particle type. For one particle type and reactions r : d-{r) <i+(r) 
we have 

dc{t) 



dt 



Y,id+{r)-d^{r))arc^-^^\t) (14) 



where in the right-side part there can be arbitrary polynomial of c. We are 
interested only in non-negative solutions of this equation. Consider a particular 
case, the Schloegl model [28j, where there are only reactions of types — )• 
1, 1 — > 0, 2 — > 3, 3 — > 2. Denote the corresponding Ur by 001,010,023,032. It 
is not difficult to show that the unitarity condition holds only in the following 
three cases: 

1. "input-output": 023 = 032 = 0; 

2. aoi = oio = - we call this case the closed Schloegl model; 

3. if 

O23 _ Oqi 

032 oio 

One can show also that in these cases not only unitarity condition holds but 
also the detailed balance condition 

When in general first four coefficients of the polynomial [T3] are different from 
zero, then on the positive half-axis there can be either one or three fixed points. 
In the latter case the right and left fixed points are stable, and the middle fixed 
point is unstable. 

Remark 6 For several molecule types the class of polynomials, corresponding to 
reactions with or without conservation laws, is sufficiently wide. As an example 
consider the set R{I) of all reactions r, where I = /(?') = 0{r). Then 



J2 ar{d+{v,r)-d^{v,r))'[lci- 
reR(i) vei 



{v.r) 



that is we have an arbitrary polynomial. 

It follows that non-reversible chemical reaction systems may have behavior of 
arbitrary complexity. For example, many systems with cycles are known J^. It 
seems one can prove that chemical reaction systems can model any algorithmic 
behavior (that is any finite automata). From one side, it confirms unbounded 
possibilities of biological systems, and from other side it can be a source of 
artificial adjustment of the theory to experiment. 



3.2 Fluctuations and Onsager relations 

The behavior of systems in a neighborhood of a fixed point (that is close to the 
equilibrium) was much studied in statistical physics. Thus in the fluctuation 
theory for equilibrium dynamics (that is dynamics conserving the equilibrium 
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measure) one considers the neighborhoods of the concentrations Cy of the order 
■^-^j one can also perform hnearization of the dynamical system in a small 
neighborhood - this is one of the ways to get Onsaget relations. Now we give 
exact definitions. 

Linearization and Onsager relations Consider small perturbations of the 
initial data ny{0), that is assume that the limits 

,(0) . 1„ ^ 

belong to a small e-neighborhood of the fixed point. 

The linearization of the equations ^ around some distinguished solution 
Cy (t) gives the following equations for the variations Xy (t) of the solution c„ (t) 



^ = 5] a.(d+(., r) - r)) ^ d_ K r)c^("-)- V n ^'-^'""^ 

r u w^u 



In particular, if as a distinguished solution we take a fixed point Cy{t) = Cy, then 
we have the system of linear differential equations with constant coefficients 

^ = ^a.(d+(«,r)-d_(i;,r))^d_(«,r)c^("-'^)-V n^^^"'''^^ (15) 

r u w^u 

Rewrite it as 

== ^ KuXu (16) 

U 

where the matrix of coefficients is 

Xy^ ^Y.^,(d+iv,r) ~ d.iv,r))d.iu,r)ci-^^'^^-' ]Jct^^^ (17) 



Theorem 7 Under the chemical reversibility condition the following Onsager 
relations hold 

Proof. From ^ we have 

A.„c„ =^a.(d+(,;,r)-d_(t-,r))d_(^/,r)[]4-("'''^) (19) 

r w 

Assume now that the detailed balance condition holds both for direct and inverse 
reactions r, r' 

arY[ct^^''^ =ar,l[ci+^-^^^ (20) 
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Then the contribution to the expression from two mutually inverse reactions 
r, r' equals 

ar{d+ {v,r)- d_ [v, r))d_ (u, r) J] 4" ^"'•'^^ + 

W 

+ a,,(d-(f , - d+{v, r))d+iu, r) [] 4+ (21) 

The contribution from the same reactions to the expressions for XuvCy, similar 
to p9| . equals 

ar{d+{u, r) - d. (u, r))d_ {v, r) [] ("'■'^) + 

+ a,, (d_ {u, t) - d+ {u, r))d+ (t,, r) n 4+ ^'"'''^ (22) 

w 

It is easy to see that the expressions (PT|) and coincide. In fact, the terms 
containing the product's d-{u,r)d-{v,r) and d+{u,r)d+{v,r), in pT|l and (|22p 
are identical, and the remaining terms are equal correspondingly to 

ard+ (v, r)d. (w, r) \{ ct ^^^^^ + ar'd. (v, r)d+ (u, r) [] 

and 

ard+ {u, r)d^ («, r) [] ct ^^^^^ + a,. (d_ {u, r)d+ (i;, r) [] (-•'^) 

w w 

But due to detailed balance condition pop these expressions also coincide. 



Entropy If the unitarity condition of Stueckelberg holds, then one explain 
the increase of the entropy H{c) in a sufficiently simple and intuitive way. In 
fact, in this case the Poisson measure Q with the parameters Mci is invariant. 
One can indicate a model where the dynamics leaves invariant the class of all 
Poisson measures, exactly (see section 4.1) pr approximately. Thus, the Poisson 
measure Pt can change with time, and its parameters Mci{t) depend on time 
somehow. Then the Kullback-Leibler divergence equals to 

PKLiQ, Pt) = / ^* In = ~MH{c) 

where 

(it is evident that iJ(c) = X^jCi)- On the other hand it is well known, that for 
any Markov process, under some technical conditions, pKhiQ, Pt) is monotone 
time decreasing, although possibly not strictly monotone. In this sense theorem 
5 is a detalization of this general assertion. 
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The entropy H{c) can be also interpreted in terms of probabilities of large 
deviations (where n is an arbitrary configuration) 

hn. '-^^HiO 

Fluctuations The fluctuations of the concentrations at time t, for fixed M, 
are defined as 

^(*^) (t) = ei*'-"" (t) = ^^w- <^^w > (23) 



This process depends, moreover, on the initial data n^(^\ or from < n„(t) >. 
Equilibrium fluctuations correspond to the process + s) in the limit s — > oo, 
when there is a stable fixed point c!j'^^'^ ~ and 

Theorem 8 Let t/ie Markov process £}v^\t), for fixed M, he stationary and 
let the condition \24\l hold. Then the limit (in the sense of finite- dimensional 
distributions) {£,v{t)) of the vector process {£,i"\t)) asM oo is the Ornstein- 
Uhlenbeck process with mean and covariance matrix 

D,,,{t-t')) =<Cv{t)^v'{t') > 

defined by the formula 1126]) below. 



Proof. For any fixed time, the vector {£,i''^''\t)) has Poisson distribution, 
thus it converges in probability to a Gaussian vector {£,v{t)) which has moreover 
independent components and 

<Ut) >^o,<C{t) >^ci 

Otherwise speaking the probability density of the vector {£,v{t)) is 

p = const exp(-- ^ ^2-) 



The quadratic form in the exponent coincides with the quadratic part of the 
Taylor expansion of the function H{c) at the point c — c. That is, the covariance 
matrix l3~^ is diagonal with diagonal elements c^. By definition, the matrix of 
kinetic coeflScients 7 = X/3~^. Thus it is 

By theorem 7 this matrix is symmetric as expected. 
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Now we will describe the time correlations. If the limit of the process {t) 
exists, then it is a stationary and reversible process, as it is stationary and 
reversible for all M . From central limit theorem it follows even more, see ( |14[ 
[T5]). Namely, in the limit AI — > oo this process is Gaussian with the generator 

V,W V 

where 

u 

that is the drift is defined by linearized kinetic equations see also [53]. 

This can be checked by a straightforward calculation: the drift at point 
(ni, ny) is equal to 

S.u{ni,...,nv) = 

= ^(d+(z;,r)-d_(«,r))a,M-™W+i[|n^(n^-l)...(n„-d_(u;,r) + l) (25) 

r w 

Put 

(M) 

Consider the stable fixed point ci*^^ — where in particular 

In the M~ 5 -neighborhood of this point, more exactly for the points q^M~2^ let 
us find the vector field of drifts, already up to Af ^2 . For this substitute 

into (|25p . The resulting expression is similar to the expression for linearized 
system The conservation laws holds here as well. Hence, in the limit we 

get a Markov process with linear drift, that is Ornstein-Uhlenbech process, as 
the unique reversible stationary Gaussian process. 

The diffusion matrix can be found from the condition of stationarity of the 
Gaussian measure 

L> = 

This condition leads to the equation 

£1/3 = -A 

or 

D = -Xp-^ = -7 
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Otherwise speaking, the diffusion matrix coincides with the matrix of kinetic 
coefficients. This connection between D and /? hoids of course in the generai 
theory of equiiibrium fiuctuation as weli [S]- The multi-time covariance 

can be found from tire system of linear equations 




with initial condition 0(0) — /3 Thus 

= e^'r' (26) 

.The symmetry of the matrix (j) is obvious. In fact, Onsager relations can be 
written as A' — /3A/3^^, where the prime means transposition. Thus 

which means that the matrix e^*/3^^ is symmetric. 

Kubo formula Consider the matrix of kinetic coefficients — XuvCv In 
a neiborhood of the fixed point let us compare the quadratic covariance form 
and the quadratic part of the Boltzmann entropy. Both depend on the chemical 
reaction system and are defined by the reduction procedure of the quadratic 
forms with the conservation laws. 
For the speed process 

its covariance matrix 

'&vn.{t) J^(t)J^(0) > 

is 

m = -^Ht) = -x'Ht),t>o 

From this the famous Kubo formula (more exactly its classical variant) follows 

/ d{t)dt = 7 
"'0 

where 7 is the matrix of kinetic coefficients. 

3.3 How non-reversible reaction systems come into play 

The problem of time non-reversibility is the central problem in physics, and 
even more in biology. Thus it would important to understand what elementary 
sources of non-reversibility could be in general. 



18 



Non-reversibility is related to the openness of the system, in particular 
with transitions hke transport. For example, introduction of inputs, outputs 
or transport channels between reactions, also introduction of complementary 
substances. This can be realized physically by external fields (gravity, electro- 
magnetic fields), current, in which the reactions occur, or with difference of 
diffusion constants. 

Other source of non-reversibility are various analogs of the famous Boltz- 
mann idea, called the Boltzmann-Grad limit in mathematical physics. There 
are many other parameters in closed systems the scaling of which allows to 
get non-reversible systems. For example, large deviations in the system can be 
considered as a special scaling in the initial state, when the system is driven 
far away from equilibrium and then one can follow the path of reaching the 
equilibrium. 

3.3.1 Transport 

Let we have several closed system of chemical reactions. One could join them 
together, allowing transport of substance from one system i to another j. We 
will say then that there is a transport channel from z to j. We want to show that 
after appending transport to the system it becomes in general non-reversible. 

Consider a closed chemical reaction system, satisfying the detailed balance 
condition © with parameters by of the Poisson measure. Introduce in addi- 
tion inputs and outputs, as mutually inverse reactions, for some substances 
with parameters ai„^„, aout,v For the system to stay chemically reversible these 
parameters should satisfy the following restriction 

bv = 

Consider now two independent closed systems and connect it by the transport 
channel with rates 

where rij „ is the number of molecules of type v in the system i = 1,2. Again we 
get that the condition © will hold only for one value of the parameters ■ 

3.3.2 Constant concentrations 

In chemical kinetics one often encounters the assumption that one or more sub- 
stances have constant concentrations. The first question is when the chemical re- 
action system with constant concentrations of some substances is non-reversible. 

Consider a reversible system R of chemical reactions with substance from the 
set V. Let by be the concentrations, satisfying the detailed balance condition. 
Fix somehow the concentrations Cv from the set W C V, in general they different 
from by. Consider the reduced system of reactions with the substances from the 
set V\W, assuming that there is no reactions where enter only substances from 
W. 
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Then the numbers 4'{v) — |^ should satisfy the equation 



d+(v,r) 



for any reaction r E R. Thus, the function h{v) ~ ln(/)(i;) is an additive first 
integral for any reaction r G i?, that is 



'^d-{v,r)h{v) = ^d+{v,r)h{v) 



Here h{v),v G W, are some given positive numbers, the rest h{v),v ^ W, are 
variables. Denote £ the set of all additive integrals of our system of chemical 
reactions, and Hw is the subspace, consisting of the functions f{v) such that 
/(v) = In 1^ for u G W. The dimension of this subspace equals \V\ — \W\. Thus, 
if \ W\ > dim£, then generically (that is for some open everywhere dense set of 
values c„, w € W) the intersection £ n T-Lw is empty. The exceptional values of 
the parameters Cv,v G W, are the projection of the subspace C on the coordinate 
plane {cv,v G W} and cannot fill in all this plane if \W\ < dim£. Thus, if in 
the reversible system R we fix k + 1, where k = dim C, then the resulting system 
in general will not be reversible. 

Example 9 For a system of reactions with atoms C,0,H of carbon, oxygen 
and hydrogen one has three first integrals - conservation of the numbers of these 
atoms. For sufficiently reach systems of reactions in organic chemistry there are 
no other independent integrals. Thus here fc + 1 = 4. 

Remark 10 // there are reactions with substances only from W , then they can 
be excluded from the list of reactions of the reduced system. If the exclusion 
of these reactions does not change dim£ (for example, if the reaction r can be 
changed to a chain of reaction), then the previous conclusion persists, as they 
are based only on the comparison of Ami C and \ W\. 

Above it was essential that, up to the exclusion of these reactions, the de- 
tailed balance condition of the reduced system coincides with the detailed balance 
condition for the initial system. For the unitarity condition and the fixed points 
this is already not true. 

Formally, one can get constant concentration, for example of one substance 
1^0, using various scaling limits. One of the possibilities is to take the concen- 
tration vq big enough, moreover in the rates ([2]) of the Markov process one 
substitutes Mn^„ instead of n^o, or, that is the same, to subtract d-{vQ,r) from 
m_(r). Then the limiting kinetic equations 

^ = /(ci,...,cv) 

will be 



dcvit) 
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dt 



0, Cvg (0) = Ci 



Alternative way is to introduce input and output vq, which have large rates 
a,v,in.,av,out, so that the stationary distribution of the process "input-output" 
has a fixed value. Evidently, we will get constant concentration in the limit. 

Inverse problem How to get given non-reversible reaction from reversible 
ones ? Consider some non-reversible system i?„ consisting of several pairs of 
mutually inverse reactions. They are defined by the rates a^. Note that for some 
values ar this reaction system is reversible. Assume that in each reaction r some 
substances (enzymes) w = w{r) participate. That is why in the expression ([2]) 
for the reaction rates there should be factor c^. If one assumes as above that 
Cu,(,.) are constant, then the rates change to arCu,(r), and by adjusting the 
concentrations Ci„(r) one can get necessary values a^. 

4 Stochastic local models 

4.1 Stochastic models with mixed dynamics 

Classical chemical kinetics is the typical example of what is called mean field 
theory in physics. Also, mixed models are possible where the reactions are 
described by mean field models, but some local transport is introduced as well. 
These models are useful for joining together chemical kinetics and chemical 
thermodynamics in ONE microscopic model. In the models introduced in |19) . 
the mean field dynamics for chemical reactions is complemented by the free 
movement of particles. These models allow to deduce main laws of chemical 
thermodynamics. Here we describe only the limiting dynamics itself, referring 
the reader for all applications to [El [20] . 

Dynamics of finite system of particles Firstly, define the dynamics of 
finite particle system in the volume A C i?"^ with periodic boundary conditions. 
At time t = Owe throw N particles to this volume, uniformly and independently, 
where N is random and has Poisson distribution with the density ^^'^ = c. To 
each particle we prescribe independently the type j and velocity v, which has 
density po(j, v) (with respect to Lebesgue measure) 



If the velocities took only finite number of values then the chemical reaction 
system could be defined exactly as in section 1. In case of continuous velocities 




Assume for simplicity that only binary reactions exist 



r = 



{j,v),{juvi) {j',v'),{j[,v[) 



(27) 
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instead of parameters Qr in ([5]) we introduce the rate densities, that is integrable 
(in all four variables) functions 



Thus, each particle i changes its type and velocity at random moments 



In the intervals between these moments the particle moves with constant veloc- 
ity, obtained in the latter reaction. 

Dynamics of the infinite system Consider the set X of countable locally 
finite configurations X = {xi,Vi,ji} of particles in R^, where each particle i 
has coordinate Xi , velocity Vi and type ji . Denote 9Jt the set of all probability 
measures on X with the following properties: 

• the coordinates of these particles are distributed as the homogeneous Pois- 
son point field on with some fixed density c; 

• the vectors {ji,Vi) are distributed with common density p{j,v), 



independently of the coordinates and other particles. 

Random dynamics on X is given by the pair (X"'°°,/i), where /i = 
is the probability measure on the set X*^'"" of countable arrays X'^'°°(t) = 
{xi(t),Vi{t), ji{t)} of piecewise linear trajectories Xi{t),Vi{t),ji{t)),0 < t < oo. 
It is assumed that the measure /i belongs to the family 971"'°° of measures on 
X°'°°(t), defined by the following properties: 

• if for any t we denote fi{t) the measure induced by the measure ^ on X, 
then fi{t) £ M. Denote 



where Ct,pt are the concentration- and the densities at time t; 

• the trajectories {xi{t),Vi{t), ji(t)) are independent for different i and each 
of them is a trajectory of some Markov process, not necessarily time ho- 
mogeneous. This process is defined bu the initial measure /i(0) £ 9Jl and 
by infinitesimal transition probabilities at time t, moreover the latter do 
not depend on coordinates, velocities and types of other particles, but 
depend on ct{i,v) at time t\ 



til < ti2 < ■■■ 




ct{j,v) = ctpt{j,v) 
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• the evolution of the pair (j, v) for individual particle is defined by the 
following Kolmogorov equation 



dpt{ji,vi) ^ 
dt 

/ iP(t'Ji^'"i\j^'")PtUiv) - P{t■,j,v\jl,Vl)ptijl,Vl))d■ 



lv 



where 



P{t; ji,vi\j,v) = Y. 2ar{{ji,vi),{j[,v[)\{j,v),{j',v'))ct{f,v')dv'dv[ 



Note that in the reactions there can be energy conservation law, see ]TE[ 
I19j . then the integration in the last formula includes the corresponding 
(5-functions; 

• coordinates of the particle i change as 



Let the measure /i(0) € 9Jt be given. Consider now the sequence of finite system 
of particles, defined above, in an expanding system of finite volumes A ^ -R'^- 
The initial measure for any of finite systems is the restriction of the measure 
/i(0) on the corresponding volume A. Hence, at the initial moment we can fix 
a separate particle i in and can consider its trajectories x['^\t) in each A, 
starting from some. Besides this, its trajectory Xi{t) g X°'°° is defined in R^. 

We have seen that two definitions - for finite and infinite particle systems - 
are quite different. The following result shows how they are related. 

Theorem 11 For any i and t we have the convergence in probability 



Proof see in the Appendix to the paper |19) . 

4.2 Boltzmann equation with chemical reactions 
4.2.1 Model and result 

Assume that at time t — in the cube A C i?"* there are N < oo particles, 
each particle is characterized by the coordinate x € A, velocity v e i?'' and type 
q G {1, Q}. The initial vector {xi{0), qi{0), Vi{0) : i = 1, N) will be denoted 
by luq. Assume that the initial measure /iA on the set uj^ of configurations in A 



Xi{0) + / v.i{s)ds 
Jo 




lim X 
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is defined by the probabilities that the number of particles in A equals N, 
and by the conditional densities (for given N) 

PN,A{xi,Vi,qi,...,XN,VN,qN) < 

symmetric with respect to the permutation group ^jv- and normalized so that 

N 



4t X] / p^'^ ri '^^kdvk = 1 



qi,...,qN fe=l 

Then the fc-particle correlation functions are defined as 

oo . N 

fk{xi,vi,qi,...,Xk,Vk,qk) = ^ (N - kV. ^ Pn,a 

N=k^ ''■ gfe+i,...,giv j=k+l 

Hence, the probability that in any of small volumes dxidvi, i = 1, k there is 
a particle of type g,, is equal to 

k 

fk{xi,vi,qi,...,Xk,Vk,qk)'[[dxidvi (28) 

i=l 

For any initial configuration oJq define the continuous time Markov process 

^{t,co) = ^jv,A(i,w,Wo) = {xi{t),Vi{t),qi{t) : i = 1,2,..., N) 

In the defined system the randomness related to the initial (for t = 0) config- 
uration is denoted by Wg , and the randomness related to the random jumps is 
denoted by oj. Heuristically ^{t,uj) is defined as the mixture of deterministic 
(piecewise linear) dynamics (with periodic boundary conditions) for the coor- 
dinates and random jumps for the velocities and types. These random jumps 
are assumed to be binary reactions, which change velocities and types. More 
exactly, the velocities and types are assumed to piecewise constant on [0,oo); 
the jumps occur at random time moments 

< ti{uj) < ... < tk{uj) < ... (29) 

On the time intervals t G {ti, U+i] the particle move freely ^^'i*-* = 0, that is 
with constant velocities Vk{t) = Vk{U + 0). Thus almost everywhere we have 
"i^kit) = ^^t^- Thus, the coordinates at time t e i?+ are defined as 

t 



Xi{t,uj) = Xi{0) + / Vi{t,uj)dt 
Jo 



At the same time any pair of particles i,j (independently of the other pairs) on 
any time interval {t, t + dt) change their types and velocities with the rate (rate 
densities) 

KQi^v[,q'j,v'j\xi{t),Vi{t),qi{t).Xj{t),Vj{t),qj{t))dt 

The functions A are assumed non-negative, bounded, smooth, translation in- 
variant and equal zero, if at least one of the following conditions holds: 
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1. \xi — Xj \ > 2r; 

2. for some > either \vl\ > or \Vj\ > v^. 

These jumps do not change coordinates, but change velocities and types 

{qi,Vi,qj,Vj) = {qi,Vi,qj,Vj)it) {q[,vl, q'j,Vj) = {q'i,vl,qj,Vj){t + 0) 
Denote 

B{v,q,v',q'\vi,qi,V2,q2) = 

= Hv,q,v',q'\x,Vi,qi,x,V2,q2) 

Thus, for given N,A,X,r we have defined the family ^N,A{t) of processes with 
finite number of particles. 

Remark 12 This model allows many generalizations, for example when the 
movement of particles between jumps is defined by the Hamiltonian system with 
pair potential V{x — y) and interaction radius r 

d^Xi{t) dV{xi — Xj) 

Initial conditions We consider the family Hr of initial distributions in a fi- 
nite volume A or in with correlation functions /^'"^ (0; Xi,vi,qi, .... .Xfe, Vk, qk), 
parametrized by positive numbers r (interaction radii). It is assumed that this 
family satisfies the following conditions: 

1. (Boltzmann-Grad scaling) For some fixed bounded non- negative function 
f{x,v,q) 

f['\0;x,v,q)=r-''+'f{x,v,q) (30) 

This scaling says that the mean density of particles grows as r^'^+^ as r — > 
0. Note that simultaneously "effective" volume Nr'^ (r can be considered 
as "effective" radius of the particles), occupied by the particles, tends to 
zero as r; 

2. (exponential decay of correlations) 

\f^''\0;xi,Vi,qi,X2,V2,q'2) - f[''\0;xi,Vi,qi)f[''\0;X2,V2,q2)\ < 

< C exp{—Cir~^\xi — X2\) 
for all positive sufficiently small r — > 0: 

3. (strong stability) The number of particles n{A) in arbitrary volume A C A 
is uniformly bounded a.s. by cr~''+^ |j4| for some c > 0. It is a physically 
natural condition; 
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4. (bounds from above) for some C > 



/^"^(O; xi, «i, qi, Xk,Vk,qk) < CM-'^+l'^ fc > 1 



Let us give an example of a point field, satisfying conditions 1-4. Consider first 
the Poisson field with the correlation functions 



for some smooth bounded functions gi. Define Hr as the point field, obtained 
from the Poisson field with /c-particle functions g^^^ = r'^^^^'^'g^ by the trans- 
formation F on the set of configurations, where the configuration uji = F{ujo) 
is obtained from loq by deleting any particle for which in ujq there is another 
particle on the distance less or equal to 2r. Then the properties 1,3 follow from 
the definition. The property 4 follows from the monotonicity 



The property 2 follows from standard estimates of the probability that there 
exists a cluster (a sequence of particles with the distance not more than 2r of 
subsequent particle from the previous) of the diameter ^|a;i — a;2|, containing at 
least one of the particles xi or X2- 

4.2.2 Existence of cluster dynamics 

We say that two particles i,j interact at time t, if at this moment a reaction 
occurred between them, in particular at this moment the distance between them 
was not more than 2r. Denote Sij the first moment of interaction of particles 
i and j. Consider the following finite random graphs = G^(t) = G^{t,uj). 
Their vertexes are the particles, it is convenient to enumerate them with their 
initial vectors Xi{Q). Two vertexes are connected by the edge if on the time 
interval [0, r] these vertexes interacted at least once. For fixed r and A the set 
of vertexes of any connected component of the graph = G"^(r) is called a 
dynamical cluster (in A). 

If at point X at initial moment there is a particle then denote P^{t\x) the 
conditional probability that the dynamical cluster to which this particle belongs, 
consists of exactly k particles. Put 



Then the following exponential estimate holds, see |21j . 

Theorem 13 Their exist constants C, ao > such that for any t,v^ ,r and 



k 

gkixi,Vi,qi,...,Xk,Vk,qk) = J]^ 3i(2^i, ^j) 



i=l 




q 



p — a{Tv^r' 




(31) 
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with arbitrary < a < ao uniformly in k, A, a: the following inequality holds 

Pt{r\x) < {Caf-^ 

Remind that the expression for the density has the following meanng: the 
mean number of particles < > in the unit volume, multiplies on maximal 
volume of the tube, covered by the particle (that is 2r-neighborhood of its 
trajectory), were less than some ao- Proof see in [21 . 

From this theorem it follows that with probability 1 any particle on the 
time interval [0, r] belongs to a finite cluster depending on the chosen particle 
and on the initial configuration. Moreover, there is the thermodynamic limit 
which is the cluster dynamics in R'^. Otherwise speaking, the dynamics of 
infinite number of particles is obtained from infinite number of independent 
finite particle dynamics. 

More exactly, there is the following cluster representation of the dynamics. 
Consider the Markov process ^fc (<) = (a;i(t), Xfc(t), Wfc(i), gfe(t)) on 

the time interval [0, r] with k particles (assuming the absence of other particles), 
if initially the particles were at points ^fc = ^fc(O) — {xi,vi,qi, ...,Xk,Vk,qk)- Let 
us denote 7 — 'y{ri\(,) the trajectory of the process ^k{t)- starting at time at 
point ^ and ending at time r at the point 77 = {x'i,v'i, gj., xj,, u^, g^). Denote 
P'^ilivlO) tlis conditional distribution on the set {7(?7|C)} of such trajectories 
Let Ffc = Tk{ri\£^) be the set of all such trajectories 7, which form a fc-cluster. 

Then using (^5)) we get 

f{T;x,v,q) = 



OC 00 p n- n- p 



k=lqi,...,qk^^ i=l i=2 

J „' ™' „' ' 



dP^(7((x,i;,g,X2,-y2,'?2: 4> ""L '?fc)IO)/fc(0; xi, wi, gi, a;fc, Wfc, g^) 

where Q(7) — Q(7(f]|C)) is the conditional probability that other particle in the 
configuration o;^ do not interact with the distinguished k particles. 

4.2.3 Proof of the Boltzmann equation 

If the existence of cluster dynamics holds for fixed r, then the Boltzmann equa- 
tion holds only in the Boltzmann-Grad limit. Fix r and u° and assume that 
the function f{x,v,q) from the condition (1301) is sufficiently small so that the 
conditions (PT|) holds. 

Theorem 14 Then in the Boltzmann-Grad limit for any t < t there exist the 
density functions 

\imr<'-^f^-\t-x,v,q)= f{t-x,v,q) 

r— ^0 

which satisfy the Boltzmann equation 

df , N df , 

— (x,v,q) = -v—(x,v,q)+ 



27 



+ X! J[Biv,q,v',q'\vi,qi,V2,q2)fix,Vi,qi)f{x,V2,q2)- 

9', 91:92 

-B{vi,qi,V2, q2\v, q, v' , q')f{x, v, q)f{x, v' , q')]dvidv2dv' 

In the zeroth approximation (that is if there is no interaction) there are only 
1-clusters and then 

fit + S; X, V, q) = f{t; x - v5, v, q) (32) 

Subtracting f(t;x,v,q) from both sides of this inequahty, dividing by S and 
passing to the hmit 5 — > 0, we get 

dt dx 

In the general case the equality ([5^ corresponds to the event, that the par- 
ticle which were at the point x, v at time t, did not react in the time interval 
{t,t + dt). 

In our case we can write 

fit + S; X, V, q) = fit; X - vS, v, q) - A^{^ + b'^;^ + 0(^2) (33) 

The term Ai is obtained from the events, when at time t there were a particle 
with parameters x — v5, v, q, which in the sequel (in some time s,t < s < t + S) 
reacted with another particle, which at time t had the parameters xi,vi^qi. In 
other words 

rt+S 

^(r) ^ X! J ds J Xiq',v',q[,v[\xis),vis),qis),xiis),viis),qiis)) 



9l>9 ,9i 



f^\t] X — vS, V, q; xi, vi, qi)dxidvidv'dv[ 

Note that as it follows from the cluster property, the decay of correlations is 
conserved for any time moment in the interval < t < t. Then 



4"^~>S ^ J Biq',v',q[,v[\v,q,v,, 



qi)fiiq,v)fiiqi,vi)dv'dv[dvi 



91:9 ,9i 



(r) 

The term appears from the events, when at time t there are two particles 
with parameters xi, wi, gi, X2, W2, 92, which react at time s,t < s < t + 6 so that 
one of emerging particles has parametersa;, v,q. Thus, 

^(r) ^ X! / ds Xiv,q,q',v'\xi,Vi,qi,X2,V2,q2) 

91.92,9' * 

f2''\xi,vi,qi,X2,V2, q2)dxidvidx2dv2dv' 
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Similarly we have 

liniSj''' = 5 / B{v,q,q',v'\vi,qi,V2,q2)fiiqi,Vi)fi{q2,V2)dvidv2dv' 

From the cluster representation of the dynamics it easily follows that the 
remaining clusters do not contribute to the Boltzmann equation, as they the 
order 0{S^). 

Remark 15 Other models and other techniques of proving the Boltzmann equa- 
tion see m 121 [H [M [M [M Hi [M- 

4.3 Simplest models with transport on the lattice 

Let at each point x of the lattice Z'^ there can be n„ (x) particles of type v = 
1,2,...,V. In each point the Markov process — {ni{x), ...,nv{x)) is given, 
that is a chemical reaction system as defined in section 2. These processes 
are independent and have the same distribution. We add some terms to the 
generator of this process, which correspond to independent simple continuous 
time random walk for each of the particles, homogeneous in time and space. 
The parameters Xe^v^ that is the jump rates, where e runs 2d unit vectors along 
the axes,- can depend only of the type v. Assume now that the drift vectors 



i« = ^ eXe,v 7^ 



for all V. We will use the scaling 

X = — ,t = —, Xr{n) — > eXrin) 
e e 

where X e R'\t e R are macro- variables. In the definition ([2]) we put M — 1, 
so the number of particles in any point has the order 0(1). This scaling says 
in particular, that for finite macro-time r at a given point there can be 0(r) 
reactions. 

Theorem 16 Let at the initial moment t — the initial Poisson distribution 

X V ^ ^ 

of the particles on the lattice so that b^ ^ — c„(0, ex) for some smooth bounded 
functions Cy(Q, X), X G R"^. Then as e — >■ for any functions x{e) : R^ — > Z"^ 
such that ex{e) — > X , there exist the limits of the concentrations 

T 

Cv(t,X) — lim < ny( — ,x(e)) > 

e->0 e 

which satisfy the equations 

dc dc 

— ^ = -m„— ^ + f;(ci, ...,cv) (34) 

OT OA 
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where the functions Fy are the same as in the right-hand side of the equations 

Shortly, the ideas of the proof are as foUows. Firstly, it is well-known and 
easy to prove, that under no reaction condition the independent particle satisfies 
the equation (|34l) without the last term. The reactions go much slower than the 
transport and for finite macro-time their number at each point is 0(1). Thus, 
at the intervals between reactions the distributions of different particle types 
at each point tend to become independent and have Poisson distribution with 
some parameters Cy^x, due to the fast mixing by random walks. Thus in the 
limit e — >■ for any integer fc > 

^ '^v^xij^VjX 1 ) • ■ • (^^'f .a; k -\- \^ '^Poisson — ^v.x 

The estimates for the convergence of limit transitions are based on one or an- 
other variant of cluster expansions. See more details of the proofs in [22J, pp. 
308-313, 315-316 and in the references therein. 

If all drifts — 0, then one needs another (diffusion) scaling 

X = - , t = ^ , Ar (n) -> Ar (n) 

which corresponds to the difference of the scales of reaction times and tempera- 
ture movement. Here we get reaction-diffusion equations, if we assume the jump 
rates in each direction \y = ^, 

9cv 1 . „ , N 

— = -ACy + Fy{Cl,...,Cv) 

OT 2 

The ideas of the proof are similar to the previous theorem. 

There is an interesting case when the coordinates of the drift are nonzero 
in one direction (current) and zero for perpendicular directions (diffusion). Let 
us consider, for example, the two-dimensional lattice = {{x^y)} with several 
particle types, where my^^ = 0, ruy^y ^ for all v. Then in the scaling 

a; = — , y = — ,i = — , Ar(n) -> e K[n) 

the limiting equations are 

dcy dcy 1 d'^Cy 

^ = — ..x^+2^+F.(ci,...,cv) 

All kinetic equations, described above, may have several invariant measures 
if the corresponding equations 

Fy{ci, ...,cy) = 

have several fixed points. 
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5 Chemical reaction as a process 



5.1 Time reversibility in physics 

A map (function, operator) / from the set A onto the set B is called invertible, 
if it is one-to-one, that is if there exists mapping g = f^^ of the set B onto the 
set A such that gf is identical on A, then fg is identical B. Then / and g are 
called mutually inverse, li A — B, then / is called automorphism. 

Automorphism U generates the automorphism group C/*, where t d Z, and 
it is often possible to embed it into some continuous automorphism group with 
t €i R. The automorphism group of the set A is called time invertible with 
respect to the automorphism W of the set A, if 

W-^U*WU* = 1 (35) 

or = W-^U*W. 

In physics the notion of time invertibility (reversibility) is related to con- 
crete automorphisms (normally involutions) W. So; in the classical Newtonian 
physics of n particles one considers the automorphism groups of the manifold 

A" X R"'^ = {{x,p) = {xi,...,Xn,Pl,.:,Pn)},Xi G A C G R'^ , 

and W is taken equal 

W{x,p) = {x,~p) 

In non-relativistic quantum mechanics A is a complex Hilbert space, automor- 
phism group is a unitary group U* = ex-p{itH) with the generator H, and W is 
an anti-linear map. For example, in some representation 

W(j) = '^ 

If HW = WH, then §5^ holds. 

In relativistic quantum theory invertibility may take place for one operators 
W, but nor for the other, as for parity violation. 

Such physical invertibility, under certain conditions, implies reversibility of 
corresponding stochastic systems. Example is the reversibility of the transfer 
matrix in the euclidean approach to quantum field theory, the invertibility of 
the scattering matrix and reversibility of Markov processes, obtained in a weak 
interaction limit. 

The scattering matrix S : J- —?' J- is the unitary operator in the Fock space 
= J^ijhL), where H is the direct sum of all one-particle subspaces Hq in 
J-{'H). One-particle subspace corresponds to the type q particle. Let Cq^k be 
some orthonormal basis in T-Lq, where k corresponds to momentum. Let 7 = 
{(gi, fci), {qn, fc„)} and consider the basis 

e-y = eq^kt ® ■■■ ® e.q„k„,n = 0, 1, 

in T . Denote the squares of the matrix elements of S in this basis by 
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Then from the norm invariance it foUows that 

^u.(7^7') = ^u;(7'-^7) = l (36) 

7' 7' 

that is the matrix W — (w(7 — ?> 7')) is doubly stochastic. 

Note that the condition p6p corresponds to the unitarity condition intro- 
duced in section 2. Intuitively, to get stochastic dynamics from unitary scat- 
tering matrix one could do as follows: introduce random waiting times in the 
states 7, then matrix W will play role of the matrix of conditional probabilities 
(at the end of waiting time) of jumps from 7 to 7'. There is one more difficulty 
- 7 depend on index fc, which correspond to momenta, or to velocities. It is 
desirable that the process, obtained by restriction to the set of types {q} would 
be Markov. And moreover, that the matrix which is obtained by restrict- 
ing the matrix W to the set of types, also be doubly stochastic. This would 
mean that there is restoration of classical chemical kinetics, which is normally 
defined without taking into account velocities. In [20] it is shown that under 
some conditions this really happens. 

Under certain limiting transitions unitary quantum dynamics becomes stochas- 
tic, for example in the weak interaction limit, see for example |27| . moreover 
one has reversible Markov process. 

5.2 Classical Hamiltonian scattering 

The first question is whether any bound state can be obtained dynamically by 
colliding its components. It is not always possible. It is simpler to see from 
the classical scattering theory, already for the simplest example of scattering of 
one particle on the center, see [T]. The main restriction is of course the energy 
conservation law, that is of the sum of internal and kinetic energies. We do not 
know whether it is the unique restriction. 

Scattering of one particle on external potential Let us consider one- 
dimensional problem of scattering of one classical particle on smooth external 
potential V{x),x S R, equal zero outside some bounded interval. Let the parti- 
cle move from —00 with speed vq. It is known that the formation of the bound 
state, that is the capture of the particle by the potential, is possible only for 
the set velocities of measure zero. This follows from the time invertibility of the 
dynamics. In fact, three cases are possible: 

1) the particle changes the direction of movement. This can be only in the 
point where ^ 7^ 0. Then the particle passes the same path in the opposite 
direction; 

2) the particle stops. This can occur only in the points ^ = 0. The number 
of such values of vq is finite. 

3) the particle passes to -l-oo. Then it does not stop and does not change 
direction. 

There similar results, see [Ij, for the one particle scattering on external 
potential for dimensions d> 2 . 
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If however one may introduce the possibility of fast or momentary energy 
dissipation, for example when the energy is transferred to the third particle or to 
some internal degrees of freedom of the two particle cluster, then the formation 
of the bound state becomes possible. The particle can fall into the potential 
energy well. 



Two-particle and three-particle scattering Two-particle scattering can 
be reduced to the previous case, and for three particles there are examples from 
celestial mechanics, see [16j, which show what possibilities are possible. 



5.3 Reaction rates from local theory 

The following simple model shows how one can obtain reaction rates from local 
models. 

Consider a free system of Ni,i = 1,2, balls of radii in the volume M, 
which move not seeing each other with Maxwell velocity distribution, that is in 
equilibrium. Denote Ci = the fractions of such particles. It is easy to prove 
that the number of binary reactions "collisions" of balls of different types on a 
large time interval [0, t] is asymptotically equal to (if Ni, M —J- oo,) 

\ , , ) 12 

Thus, the mean number of collisions for u nit time and volume is equal to 

R 47r(ri + ra)^ 

m = 3 '^'^ 

The part of energetic collisions, that is such that the sum of kinetic energies is 
not less than some number T^r, is approximately 

ar exp(— /3Tct)ciC2 

for some constant a^, corresponding to a given reaction. This is the contents of 
the Arrhenius law. 

Various mathematical problems, related to the transfer of chemical energy 
to kinetic energy see in [HI [191 EO] . 



5.4 Dynamics with non-momentary reactions 

Let us consider the infinite system of point particles in R'^ , where each particle 
is defined by the coordinate x, velocity v and type j = 1, J. The particles 
interact via pair potentials Ujji{x — x'). It is assumed that the interaction 
radii are finite. Define the graph with vertexes in the particle coordinates, 
connecting two particles of types j, j' with an edge, if the distance between 
them does not exceed some Rjji . To the vertex also we prescribe velocity and 
type of the corresponding particle. Consider connected finite marked graphs G 
with vertexes marked in this way. There are continuum of such graphs, and we 
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introduce the equivalence classes of such graphs. Two graphs Gi and G2 are 
called equivalent, if at least one of the following three conditions holds: 

1. Gi and G2 are isomorphic as marked graphs, that is they are isomorphic 
as graphs and the marks of the corresponding vertexes coincide; 

2. Gi and G2 are obtained from one another by shifting all coordinates with 
the same vector; 

3. Gi and G2 are obtained from one another by Hamiltonian dynamics of 
the corresponding particle system with potentials Ujji{x ~ x') for finite 
time. 

The equivalence class will be called cluster or metastable particle. Metastable 
particle is called stable, or a bound state, if it exists for infinite time under the 
absence of other particle. 

Infinite system of particles in R'^ at any time moment can be partitioned on 
(maximal) connected components. Each component corresponds to a cluster. 

Assume now that there exists Gibbs equilibrium state for the given particle 
system (in particular, that the potential is stable). Then under some conditions, 
for example for small density of particles, one can prove that at any time moment 
all clusters are finite with probability 1. Moreover, some extended clusters 
(called above the dynamical clusters) stay finite on some on some time interval, 
see PI]. 

However, other problems, for example about the existence times of clusters 
are open. For example, it seems that (stable) bound states are absent with 
probability 1, except of course one-particle clusters. In fact, let we have for 
example only two types of particles 1,2 and the potential V12 is such that the 
unique possible bound state consists of two particles, where one of the particles 
rotates around another with the circle orbit. Some relation between velocity 
of the rotation and the distance (radius of the circle orbit) between particles. 
But, as the distributions of coordinates and velocities are independent, this is 
possible only with zero probability. 

From other side, there exist infinite number of metastable clusters, where 
these relations hold approximately, and clusters live sufficiently long and disap- 
pears either by itself or after collision with other cluster. Interesting problem 
is to estimate the life time of a cluster as depending of the parameters of the 
Gibbs distribution. 

However, there are many other open questions concerning connection of the 
notion of particle in finite and infinite systems. 

In finite particle systems, classical and quantum, one first introduces elemen- 
tary particles. In the classical case as the point particles, in quantum case as 
creation-annihilation operators. The Hamiltonian can have also bound states. 
In classical case these are the orbits of some type, in quantum - eigenfunctions 
of the discrete spectrum. In some cases one can show that they completely 
determine possible asymptotic states of the system. In principle, bound states 
of any number of particles are possible. 
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If we consider infinite system, tlien tliere exists a certain tlieory only for equi- 
librium dynamics, that is the dynamics while the system is in the equilibrium 
(Gibbs) state. Here also elementary particles, called bare or unrenormalized 
particles, which however do not belong, contrary to the finite systems, to the 
discrete spectrum after the thermodynamic limit. New discrete spectrum can 
appear (more exactly, one particle states). The main hypothesis, proved in some 
cases, is that the pair (Hilbert space, Hamiltonian) , corresponding to given in- 
finite interacting system of particles, is unitary equivalent to some similar pair 
for a system of non-interacting particles, which are called then quasi-particles. 
These quasi-particles can be close to bare particles for example if the interaction 
is small. In physics a quasi-particle is often imagined as a particle surrounded by 
a cloud of other bare particles. This could give a bridge between quasi-particles 
in infinite systems and metastable states of finite systems, however there are no 
exact formulations and proofs. 
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